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In  this  article  we  analyse  some  continuous-time  systems 
that  contain  uncertain  parameters.  The  statistical  properties 
of  the  uncertain  elements  are  used  to  determine  conditions  that 
will  guarantee  the  stability  Cin  some  probabilistic  sense)  of  these 
systems.  By  far,  the  bulk  of  the  research  completed  on  this 
topic  concerns  systems  in  which  the  noise  terms  enter  additively 
as  control  or  observation  noise.  Systems  in  which  the  noise  enters 
as  a multiplier  have  been  given  more  attention  lately,  but  the 
results  obtained  so  far  are  quite  incomplete.  In  the  following 
sections,  we  make  some  contributions  to  this  theory. 

For  linear  systems  in  which  the  random  process  enters 
additively,  the  use  of  a white  noise  model  is  well  justified, 
especially  if  state  augmentation  is  used  to  generate  the  colored 
noise  processes  required.  Even  without  state  augmentation,  the 
white  noise  model  can  often  be  used  to  represent  wideband  processes 
because  the  extra  power  in  the  white  noise  model  will  bo  dissipated 
anyway.  For  multiplicative  noise,  however,  the  situation  is  not 
so  simple.  Using  state  augmentation  and  white  noise  to  generate 
the  required  colored  noise  process  leads  to  a non-linear  system 
model  which  is,  in  fact,  bilinear.  Without  state  augmentation, 
the  only  interpretation  of  the  results  is  in  terms  of  physical 
systems  involving  very  wideband  noise  processes.  The  main  con- 
tribution of  this  research  is  the  establishment  of  some  criteri.^ 
for  the  stability  of  the  systems  described  below  Miat  explicitly 
involve  the  power  and  the  bandwidth  of  the  colored  noisei 
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In  the  following  sections  of  this  article,  an  analysis 
progresses  from  first  order  systems  to  higher  order  systems. 
Sufficient  and  sometimes  necessary  conditions  for  the  exponential 
mean  square  stability  of  the  null  solution  are  derived.  In  Section 
IV,  the  damped  harmonic  oscillator  problem  is  treated  in  some 

I 

detail,  and  sufficient  conditions  for  the  mean  square  stability 
of  its  null  solution  are  given.  The  damped  harmonic  oscillator 
problem  was  chosen  because  it  has  received  considerable  attention 
in  the  literature  [1,  2]  so  results  are  available  for  comparison. 

It  is  an  example  of  a system  that  does  not  evolve  on  a solvable 
Lie  group,  and  we  are  not  able  to  duplicate  the  elegant  results 
that  are  often  obtainable  in  those  cases. 


II . SYSTEM  DEFINITION; 

We  will  be  studying  systems  of  the  form: 

= [A  + f(t)B]  x(t)  (1) 

The  initial  condition  is  a random  variable,  A and  B 
arc  constant  matrices,  and  f(*)  is  a real-valued  colored  noise 
process.  The  easiest  example  to  visualize  is  a linear  dynamical 
system  containing  a noisy  gain  in  the  feedback  path,  as  in  Figure 
(1). 


FIGURE  1 

MODEL  OF  LINEAR  DYNAMICAL  SYSTEM  WITH  NOISY  FEEDBACK  GAIN 
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One  major  difficulty  in  studying  and  comparing  the 
results  found  in  the  literature  is  the  abundance  of  concepts  and 
definitions  surrounding  the  phrase  "stochastic  stability".  To 
avoid  any  problems  of  this  kind,  only  the  following  types  of 
stability  will  be  considered  here: 

Definition : 

The  zero  equilibrium  solution  of  system  (1)  is  said 
to  possess  exponential  stability  of  the  pth  mean  if  there  exists 
positive  constants  a,  3,  and  6,  such  that  lx(o)|  < 6 implies  that 
for  all  t > 0, 


i P,  P 

F.  <x(t)  i £3x(0)  exp  (-  at) 

' n ' n 


where 


x^(t) 


In  this  article,  the  case  p = 2 will  receive  the  most  consideration 
and  the  phrase  "exponentially  stable  in  the  mean  square"  will 
be  used. 
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III.  SCALAR,  FIRST  ORDER  SYSTEMS: 

Although  first  order  systems  represent  only  a small 
fraction  of  all  interesting  dynamical  systems,  they  play  an  impor- 
tant role  in  the  research  described  below  for  two  reasons. 

The  formulae  can  be  evaluated  easily  and  provide  an  example  to 
follow  in  the  higher  dimensional  cases,  and  the  formulae  found 
for  the  first  order  case  lead  to  a bound  for  the  mean  square 

\ 

stability  of  higher  order  systems.  The  detailed  consideration  of 
this  case  seems  warranted. 

Colored  Noise  Results: 

It  turns  out  that  one  can  solve  first  order  linear 
stochastic  differential  equations  because  the  solution  can  be 
expressed  in  terms  of  a functional  of  the  random  processes  involved. 

[3]  That  is,  suppose  f(t)  is  a scalar  function  of  time.  Then  the 
equation 


X = (a  + f (t))x  x(0)  = Xq 


(3) 


has  for  its  solution 


x(t) 


exp 


( / (a  + f(a))da) 


Moreover,  the  mean  square  of  x(t)  is  given  by: 
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E{x(t)x*(t)} 


E[exp(2at  + 


2 f f(a)da)]x^2 
"O 


e 


2 at 


E [exp  (2 


f(a)clo)]x^2 


(5) 


rurthcrmore , if  £(t)  is  a Gaussian  colored  noise  process,  one  can 
calculate  all  of  the  statistical  properties  of  the  exponential 
funct ion  in  . 


For  the  purpose  of  making  comparisons  with  later  results, 
conditions  that  guarantee  exponential  mean  square  stability  are 
derived  next.  Assume  now  that  f(t)  is  a real-valued  zero  mean, 
stationary  Gaussian  random  process  with  autocorrelation  function 
R^Ctf,  t2)  = 0£  e , and  define  the  process 


n(t) 


f (a)do 


Then  n(t)  is  a Gaussian  random  process  with  zero  mean  and  auto- 
correlation function  given  by: 

R^Cti,  t2)  = Rf(t^,  t2)  * h(t^)  * h(t2)  (6) 

where  h[t)  is  the  impulse  response  of  an  integrator.  n(t)  is 
not  stationary,  for  at  the  very  least  there  are  initial  transients 
in  the  moments  of  tlic  process. 


III  1^1  il 
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Performing  the  indicated  convolutions  in  Equation  (6), 
and  setting  = ^2  ""  obtains: 


t) 


[2e'“^ 


2], 


t > 0 


Knowing  Equation  (4),  it  is  straightforward  to  calculate  criteria 
for  the  exponential  stability  of  the  pth  mean  of  the  null  solution 
of  System  (3).  A special  case  (p  = 1)  is  treated  by  Brockett 
[4 , page  58]  . 

Clearly, 


x^(t)  = x^CO)  exp 


(a  + f(o))da] 


(7) 


so 


E{|xCt)|P)  . eP"*  E{eP'>f*b|xjP 


But,  n(t)  is  Gaussian,  so 


(pV2)R„Ct.t) 

e 


(8) 


and  the  null  solution  of  System  (3)  is  exponentially  stable  in 
the  pth  mean  if  and  only  if 


0 


a + p 


a 


(9) 
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Rcferring  to  Figure  (2),  it  is  easy  to  identify  systems 

that  liave  rather  peculiar  properties.  That  is,  in  the  region 
2 

0 > a > - 0£  /«,  System  (3)  is  unstable  in  the  pth  mean  for  p ^ 1, 

yet  almost  every  sample  path  has  been  shown  to  approach  zero  after 

large  time  intervals  [5].  Moreover,  for  any  combination  of  a, 

? 

and  a > 0,  System  (3)  will  be  unstable  in  the  pth  mean  if  p 
is  chosen  large  enough.  Similarly,  for  any  given  p,  , and 
a > 0,  System  (3)  will  be  stable  in  the  pth  mean  if  a is  chosen 
large  enough.  This  last  observation  has  an  obvious  interpretation; 
for  a given  feedback  noise  power,  concentrating  that  power  near 
zero  frequency  provides  the  most  destablizing  (in  pth  mean) 
influence.  For  further  comments  on  the  tradeoffs  of  studying  the 
behavior  of  sample  paths  (almost  sure  stability  criteria)  versus 
pth  mean  stability,  see  Kozin  [6,  7]. 

These  results  are  easily  generalized  to  the  case  in 
which  f(t)  is  a band-pass  process,  whose  autocorrelation  function 
is  given  by: 


RfCtf,  t^)  = 0£  exp(-  a|t£-t2l)  cos  w^Ct^  - t^) 


Once  again,  the  autocorrelation  function  of  n(t)  is  given  by: 

tf  t2 

"/  / Rf(Oi.a2)da£.do2 


0 0 
2 

2o£  /terms  that  grow  \ 

—5 T min(t,,t.,)  + (loss  than  linearly! 

a * Wq  ^ ^ Vin  t^  or  t^  / 
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(pV2)R  (t.t) 
e XqI 

pa  + (p^/2)(^  0^“  i— 2 j’)  < ^ 

1 + 0)^  /a 

(10) 

in  which  case  the  convergence  will  be  at  an  exponential  rate. 

IV.  HIGIIPR  ORDF.R  SYSTEMS: 

In  Reference  [8],  Rabotnikov  uses  Picard  expansions  to 
derive  a criterion  for  the  mean  square  stability  of  a single- 
input  s ingle -output  linear  dynamical  equation  containing  a white 
noise  parameter.  The  strenj'th  of  his  method  lies  in  the  fact 
that  tlie  white  noise  hypothesis  is  not  used  until  the  end  of  his 
proof,  and  then  only  to  solve  some  integrals  involving  the  noise 
autocorrelation  function.  Without  the  white  noise  assumption, 
the  scries  of  integrals  obtained  is  too  hard  to  evaluate.  However, 
the  example  studied  in  Section  III  provides  a useful  bound  for 
this  scries  of  integrals  and  leads  to  a simple  stability  criterion 
for  the  example  treated  in  this  section. 


Then,  as  in  Equation  (8), 


cat 


SO 
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Above,  we  derived  a criterion  for  the  exponential  mean 
si^uarc  stability  of  System  (3).  Suppose  now  that  we  try  to 
derive  that  same  criterion  using  the  Picard  expansion  of  the 
solution. 

bet  Z(t)  be  the  solution  of  the  deterministic  system 


Z(t)  = - a 2(t) 
Z(0)  = 


(11) 


Fquation  (3)  can  be  rewritten  as 


Jf 


x(t)  = Z(t)  + J w(t  - a)fCo)x(a)do 
0 

where  w(t)  = e , the  impulse  response  of  System  (11). 


(12) 


Repeatedly  substituting  Equation  (12)  back  into  itself 


yields : 


V V 

(t)  = Z(t)  + / e'^^^'^^f(a)Z(o)da  + / 

1-  . \ 

I Q a(o  f 

° V V 

= Z(t)  + J e'^^^-'l)f(q)Z(q)dq  + J j 


f(o) 


•1  -a(t-qj^) 

e 


0 o *"0 

-a(q  -q„) 

e ^ f (q^) f(q2)Z(q2)dq2dq^ 

J.  S.1  ^ -a(t-q,)  -a(q.-q^)  -a(q2'q,) 

* f ^ ® ^ f(qi)f(q2) 

•'o  *'o  *^0 

f Cq3)Z(q3)dq3dq2dq^  + . . , 


(13) 
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(.ihe  convergence  of  this  scries  is  implied  by  the  analysis  of 
Reference  [5],  Section  2.1.) 

Next,  by  multiplying  the  series  in  Equation  (13)  by 


itself,  E{x^(t)}  can  be  expressed  as: 

E{x^(t)}  = Z^(t)  + terms  involving  E{f(t)} 


t.  t. 


E J y e'^*^^''^^e'''‘^^'P^f(q)f(p)Z(q)Z(p)dqdp 

J.1  -a(t-q^)  -a(q^-q2) 


o o 


r\ 


+ 2Z(t)  T:  I I a 
'0  *'o 


f (q^)f Cq2)Z(q2)dq2dq^ 


+ terms  involving  third  moments  of  f(t) 


/•  >2  H 

2Z(t)  E j dq^  f dq2  j dq^  j dq^ 

Jc\  r\ 


-a(t-q,)  -(q^-q2) 

e e 


'o  "o  •' o 0 

-a(q2-q3)  -aCq^-q^) 


f(qi)f(q2)fCo.3)f(q4)Z(q4) 


q 


/ ''■’l /jPl  f I ‘^«3 

n r\  r\ 


-a(t-qj^)  -aCt-p^) 


+ 2E  I do,  / dp,  / dq^  / dq,’  e e 

"o  o “'o  •'o 

a(q^-q2)  *a(q2-q3) 


f(p^)f  (q^Jf  (q2)f  (q3)2(q3)Z(p^) 


+ E 


V ^ 'r  ^ 

= / iJqi  / i'tz  I '■Pi  / “IP; 

*'r\  rt  ^ r\ 


-a(t-p,)  -a(t-q,) 
e e 


'0  *'0  0 •'o 

a(q,-q2)  -aCp.-p,) 

^ ^ e ^ ^ f(Pl)f(P2)f(qi)f(q2)ZCq2)ZCP2) 


(14) 
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Liquations  (14)  and  (8)  both  j;ivo  o?;i'ross  ions  for 
iHx  (t)},  so  the  right  hand  side  of  Equation  (8)  is  an  evaluation 
of  the  series  given  in  (14).  This  is  important  because  the  series 
expansion  (similar  to  Equation  (14))  for  the  second  order  system 
considered  next  can  be  bounded  termwise  by  the  right  hand  side  of 
fciuation  (14).  Therefore,  Equation  (9)  can  be  employed  as  a 
stability  criterion  for  the  second  order  system,  but  now  only 
as  a sufficient  condition. 


For  the  remainder  of  this  section,  we  will  be  considering 


the  system 


Xj  (t) 


X2(t) 


0 1 irxi(t)' 


-1  -2c 


g(t)x^(t) 


x(0)  = X, 


y(t)  = [0,  1]  x(t) 


Also  we  will  assume  that  \/e  are  interested  only  in  the  stability 
of  Xj^(t).  From  System  (15)  we  will  define  the  matrices 


0 1 


-1  -2c 


c = [1,  0] 


It  is  also  convenient  to  define 


r(t)  - X, 
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aiul  lot  g(t)  be  a stationary  colored  noise  process,  Gaussian  with 

2 

zero  mean,  variance  o and  autocorrelation  function 

g 

Rg(x)  = (19) 


Combining  Equations  (15)  through  (18),  x^(t)  is  given 
by'  tlie  integral  equation 


T 

:j(t)  = Tj(t)  + J w^(t-a)g(o)Xj(o)do 


where 


„ (O  . (e^  ' - e-'^ 


Substituting  Equation  (20)  into  itself  and  squaring  yields 

2 

E{xj^(t)}  = (t)  + terms  involving  first  moments  of  g 

t t 

• ^//  w^(t-q)w^(t-p)g(q)g(p)r^(q)rj^(p)dqdp 

o o 

+ 2r^(t)  E r / w^(t-qj)w^(q^-q2)g';  j)g(q2)tj(q2)dq2dq^ 


+ Higher  order  terms  as  in  Equation  (14)  (22) 

Turning  our  attention  back  to  Equation  (14),  and  bringing 
the  expected  value  operator  inside  the  integrals  in  that  equation, 
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ui-  sec  tliat  every  factor  of  every  term  is  positive.  This  allows 
us  to  prove  the  following  theorem. 

Theorem  1 : 

Consider  System  (15).  Suppose  there  exist  two  functions 
of  c,  say  6(C)  and  y(C)  and  a constant  6 > 0,  such  that 

i-j^(t)  < 6 t e [0,  oo]  (23) 

and 

w^(t)  £ Y(C)exp(-6(c)t)  t e [0,  «>]  (24) 

Then , 

if  (25) 

and  the  convergence  will  be  at  an  exponential  rate,  with  time 

2 2 

constant  -6(c)  + (2/a)Og  y (C). 

Proof : 

Using  liquations  (23)  and  (24)  in  (22)  yields 


7 2 2 

n(xj  (t)}  6 Z (t)  + terms  involving  first  moments  of  g 


t t 


6^E  J J Y^(C)e''^^^^^^’'l^e‘^^^^(^'P^;(q)g(p)Z(q)Z(p)dqdp 


o o 


+ 6^  2Z(t)E  /*  j Y^(C)e  " e " g(qj) 

•'o  •'o 

(26) 


2^  ^ -e(^)(t-q^)  -P(C)(qj-q2) 


^^lA]/4l[/£[[  rgpY 


The  factor  does  not  influence  the  resulr,  because  the  limit 
of  tlie  right  hand  side  will  be  shown  to  be  equal  to  zero. 

Let  us  now  assume  the  following  relations  between  the 
parameters  in  Equation  (14)  and  those  in  Equation  (26).  Let 


f(t)  = Y(Og(t) 


6(C)  = + a 


2 2,  , 2 

cJf  = Y (c)Og 


so  that  the  right  hand  sides  of  Equations  (26)  and  (14)  are  the 

2 

same  except  for  the  factor  6 . Therefore,  Equation  (9),  which 
says 


E{x'^(t)}  = 0 if  - a + 


must  imply  that 


0 if  -8(0  * I < 0 


Tins  completes  the  proof,  and  we  now  direct  our  attention  to 
making  judicious  choices  for  6(C)  and  y(C)* 


Optimizing  the  Choice  of  3 and  y: 

There  arc  conditions  that  6(C)  and  y(C)  must  satisfy 
as  functions  of  c*  Therefore,  we  are  free  to  choose  6(?)  and 
y(C)  independently  for  each  value  of  c.  The  following  constrained 
optimization  problem  can,  therefore,  be  solved  in  order  to 
optimize  the  strength  of  Theorem  1. 
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subject  to  w (t)  ^ Y exp(-Bt)  for 
Y ^ 

all  t e [0,  «].  (29) 

The  values  of  6 and  y at  which  the  maximum  is  achieved  for  each 
value  of  c form  the  functions  B(^)  and  6(c).  Using  these  values 
of  6(c)  and  6(c)  leads  to  the  strongest  version  of  Theorem  1. 

The  maximization  procedure  has  been  accomplished  with  a small 
computer  program  which  produced  the  graphs  given  in  Figure  3. 

In  the  literature  [9,  10,  6]  there  have  been  a scries 
of  stability  boundaries  derived  for  System  (15)  that  apply  to  the 
colored  noise  case,  but  none  of  which  depend  upon  the  bandwidth 
of  tiie  noise.  The  boundary  derived  by  Infante  [1]  is  the  best 
of  those  reported,  and  is  superimposed  onto  Figure  3.  For  very 
low  C,  the  curves  given  by  Equation  (28)  are  parabolic,  and,  hence 
greater  than  the  Infante  curve  for  any  value  of  a.  However,  the 
Infante  boundary  is  comparable  or  better  than  Theorem  1 for  values 
of  c up  to  about  8.  For  wider  bandwidths,  the  new  boundary  is 
superior,  except  for  c corresponding  to  greatly  overdamped  systems 
Also,  our  bound  considers  only  E(Xj^  (t)},  whereas  Infante  has  used 
E{xj^^(t)  X2^(t)}. 

In  the  literature  [7]  , there  have  appeared  plots  of 
the  mean  square  stability  criteria  for  .System  (15)  , superimposed 
on  tlic  criteria  for  the  corresponding  white  noise  parameter 
system  (Ito  sense).  This  practice  is  misleading  because,  in  the 


Maximize 
P.  Y 


STABILITY  REGIONS  FOR  SYSTEM  flS)  OPTIMIZED  BY  EQUATION 
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liifantc  ca;;c,  the  boundary  is  y.iven  for  it)).  in  the  Ilo 

7 

case,  tlie  l)Ound  is  given  in  terms  of  Og~ » '''here  g(t)  is  white 
noise  with  autocorrelation  function 


RgCf)  = 0g  6(t) 


In  the  following  paragraphs  the  result  of  Theorem  1 is  recalculated 

A 

in  such  a way  that  the  comparison  to  the  Ito  result  is  justified. 

The  power  spectral  density  of  g(t)  corresponding  to 
l-quation  (19)  is  given  by: 


S,(») 


(2/a) 


[1  + (oiVa^)] 


Suppose  now  that  we  change  the  vertical  axis  on  Figure  (3),  so 
that  tlie  stability  regions  are  plotted  in  terms  of  S (0)  . If 

o 

we  do  this,  all  the  graphs  scale  into  the  same  graph,  which  is 
independent  of  a.  This  procedure  leads  to  Figure  (4) . The  data 
presented  in  this  way  indicates  how  the  region  of  stability 
cliangcs  as  a It  does  not  change!  It  is  known  that  there  are 

A 

no  Ito  correction  terms  required  for  System  (15),  so  the  boundary 
in  I-'igure  4 is  also  a boundary  in  the  limit  as  a -*■  <»,  i.e.,  the 
white  noise  case.  Superimposed  on  Figure  4 is  the  necessary  and 
sufficient  condition  for  the  mean  square  stability  of  System  (15) 
for  the  white  noise  case  [2].  We  see  that  as  ^ becomes  large, 

A 

tlie  boundary  of  Fquation  (28)  differs  from  the  Ito  result  by  just 
a factor  of  2.  It  is  reasonable  to  expect  the  two  answers  to 
differ  by  such  an  amount  because  the  inequality  (24)  is  really 


White  Noise  Only 


REPLOTTED  FOR  COMPARISON  TO  WHITE  NOISE  CASE 


i ; !•  cunso  r\’at  i VC  . U’e  7'eiaarl;  in  passing  tliat  tiic  resiilt  of 
Tnfant'.c  can  not  be  sui)or imposed  onto  Figure  (4)  because  his 
result  would  appear  as  a straight  line  whose  slope  is  proportional 
to  a So  as  a Infante's  boundary  would  approach  the  hori- 
zontal axis,  ! 

Clearly,  the  idea  of  using  the  results  of  Section  III  j 

for  bounding  the  mean  square  response  of  higher  order  systems  j 

applies  to  more  than  just  second  order  systems.  It  works  for  any 
s ingle - i nput , single-output  system  whose  impulse  response  can  be  | 

bounded  by  a decaying  exponential,  and  whose  noisy  parameter  can 
be  treated  as  a feedback  gain. 

V.  CONCLUSION; 

, 

We  have  demonstrated  that  the  bandwidth  of  the  colored  ! 

noise  process  is  an  important  consideration  in  determining  the 

stability  properties  of  System  (15),  and  provided  a boundary  for 

the  known  region  of  stability  that  explicitly  involves  the  bandwidth 

of  the  colored  noise.  For  large  (but  finite)  bandwidths  and  for 

small  damping,  the  results  enlarged  the  previously  known  region  of 

stability  for  the  system  considered.  Also,  tlie  new  bound  was 

derived  in  such  a way  that  it  remains  valid  in  tlic  limit  as  the 

colored  noise  parameter  becomes  white.  Any  bound  that  depends  i 

only  on  the  moan  square  value  of  the  noise  process  w'ill  necessarily 

fail  as  the  bandwidth  becomes  arbitrarily  large. 


j 

* 
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